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METHOD OF INTERACTIVE COMPUTER BASED INSTRUCTION 

This invention relates to a method of comb»,ing «■"*» insttuc,ion ove ' 3 
compute, network with distributed course materials for the provision of elective 
computer-based training to a geographically dispersed group of students. 
Conventional classroom MM* has become prohibitively expensive for many 
geographical* dispersed conizations, because travel and living expenses can 
absorb up to 70 percent of the training budget. As a resuit, many organizations 
have attempted to use current computer and communications technology to reduce 
training costs. There are two commonly-used training methods. 
The first attempts to duplicate a classroom setting for a geographically dispersed 
group of students. An instructor at one location is connected to one or more groups 
„, students at remote locations using audio or video teleconferencing facilities, which 
are widely available from local telephone companies and other service providers. 
This method of instruction has the advantage of providing live two-way 
communication among geographically remote participants. However, these befits 
come at a relatively high cost. 

Each of the participants must be at a location which has the necessary 
20 teleconferencing equipment. This may invoke travel, if the participant's norma. 

workplace lacks the necessary facilities. The equipment is expense to acquire and 
maintain. The participants must also be linked by high-speed communications lines 
(ISDN. T1 or the equivalent) in order to transmit the high volume of data needed for 
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effective communication. The charges for these communications lines are quite 
high, relative to ordinary telephone lines. As a result, this method of instruction is 
prohibitively expensive for many organizations. 

The second method of computer-based training adopts many of the traditional 
methods of correspondence courses and other distance learning techniques, using 
computer technology to enhance the effectiveness of the training. Training materials 
are physically distributed on computer-readable media such as CD-ROMs. Each 
CD-ROM can typically hold all of the data required for a complete training course, 
including memory-intensive data like full-motion video. However, each student must 
,o work independently to learn the material. There is little or no opportunity to interact 
with an instructor or other students. This method of instruction has significant cost 
advantages over on-line training, but is not as effective for delivering consistent, 
timely training. 

Various methods have been attempted to reduce the cost of on-line training. 
Typically, these involve decreasing the amount of information transmitted between 
the instructor and the students. However, each of these methods results in a 
significant decrease in the effectiveness of the training, because they interfere with 
essential communication between the students and the instructor. 

The problem which the present invention seeks to address is to combine the 
20 effectiveness and immediacy of on-line training with the cost advantages of distance 
learning, in order to provide an inexpensive and effective method of interactive 
computer-based instruction. 
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According .o the present invent, a method dfcdosed for combining the on-line 
transmission o, audio or v«eo insertion and refcted d=«a Oh dfc.rfcu.ed M 
software and da* ,o reduce «. cos. and increase t. effediveness o. compute- 
based instrudio, Ih. present *ver*on afco disdoses mettods .or providing 
immediate feedback from the students to the instrudor regarding .he content and 
present o.*e fining rnate^s^ order ^perm'^ins^ctor to adapt the 
mater^to^speCiicaudienceforeachsession. The present invention aiso 
disdoses methods for enabKng each student to record and replay ail o, part of the 
nainhg session and to re-use the M*. magnate in a vartet, o« ways whfch 
10 provide continuing training benefits. 

This invent has the advanU>ge that « m*- -* • *"*< d - 
eouipped «h a CD-ROM drive and n-media hardware and software, connected 
to an ordinal .efophone «ne. rather man dedicated teleconferencing fa*es. ,n 

U,is way. each student can participate h the .raining session at .heir norma. 

workplace (or at home, if desired). 

,„ on* asped of this invention, a method is provided for P*-%- 
deHvered independent informal and e^n^e^ed time-sensi** 

geography separated iocaKons P*r to the «ma-sens«ve informal, the tone- 
20 sensrUve Wormaflon * simunaneoust, delved from a single fccat^n ,„ one or 
more indrviduais a. geography separate locaions. and the sa« «me-sens*ve 
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information is combined in an interactive manner with the said time-independent 
information at the said geographically separated locations. 
In another aspect of this invention, a computer program is used to combine 
physically-delivered time-independent information and electronically-delivered time- 
sensitive information, where the time independent information is delivered to the 
geographically separated locations prior to the time-sensitive information, the time- 
sensitive information is simultaneously delivered from a single location to one or 
more individuals at geographically separated locations, and the time-sensitive 
information is combined in an interactive manner with the time-independent 
information at the geographically separated locations, 
in another aspect of this invention, a method is provided for delivering physically- 
delivered time-independent information and electronically-delivered time-sensitive 
information, the time-independent information being adapted to combine with 
electronically-delivered time-sensitive information, comprising the steps of delivering 
the time independent information to geographically separated locations prior to the 
time-sensitive information, simultaneously delivering the time sensitive information 
from a single location to one or more individuals at geographically separated 
locations, and combining the said time-sensitive information with the said time- 
independent information in an interactive manner at the said geographically 
20 separated locations. 

,n another aspect of this invention, a method is provided for delivering interactive 
instruction relating to time-independent Information on computers at geographical* 
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grated ioca«ons where , compute, a, a *» locate is M * «*— 
„ one or more oe^raph** separated ta**. — * 

eWrt from .he compufcr a. *e said sinole tocatton. the saK .ime-sensHrve 
is used w*h the .me-Wependen. i— a, the oeoo.raphfc.lr, 
separated fccations by<he computers a, the sa* 

W da* 9 e„erated a, the sa« ^ -P— —» * «— 

a „d ar^ed a, .he s,« s*,e *«» and a response is delfcered to the sarf 
geographically separated locations. 
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this invention. 

The invention provHes a method o. interactive computer-based Wining in a "hybrid- 
mode, w«h muhimedia content stored on a CD-ROM, "ZIP" dnVe o, other suKabte 
storage medium and delivered to the remote student locations 
During on-lrne sessions, commands from ft. instmctor station direct each student 
stationtore<*v 9 U»desireddatefrom the storage medium and display it on the 
student's scr^n. Compressed audto, consisting of the insmrctc* commentary and 
student comments, command data and screen interaction information are 
,o transmitted over a communication M in real time throughout the on-line sessron. 
Unlike other video conferencing or distance team*, systems, the interactive data 
can be transmitted over ordinary telephone lines which are available in virtually 
every home and workptace; high-speed, dedfcated voice or data communications 
lines are not required, but may be used. 

Each student's workstation is able to dispfcy the full multimedia training session, 
consisting of Amotion video. mMm audio, photes, graphics, text and real-time 
annotations and commentary from the instnrcter am! other students, by combining 
the locally-stored muKimedia presentation and the interactive, real-time data. 
Each .f the individual on-line and locally stored components of the Wining session 

includes a course contra! window, a presentation window, a notes window and a 
sfctus window: The display also HcWes a series of context-sensnive control icons. 

6 
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Figure 1 shows the overall process flow for the preferred embodiment of this method 
of computer-based instruction. Figure 1(a) shows the course design module, which 
enables the instructor to design the instruction session, prepare questions and 
answers, and design presentation slides and overlays. Figures 1(b), 1(c) and 1(d) 

show the components of the course presentation process. 

Figures 2 through 14 show details of the screen displays used in the preferred 

embodiment of this invention. 

Figure 2 shows the instructor station display and controls. The display comprises a 
menu bar 1 , a course control window 3 with drop-down menu list 4, a series of 
interaction icons 6, a presentation window 8 with context-specific command icons 9, 
a notes window 11. a Cass status window 13, class feedback icons 15. on-line 
status indicator 19, and current time display 24. 

Figure 3 shows the student station displays and controls. The student display 
comprises a menu bar 1 , a course control window 3 with drop-down menu list 4, a 
series of interaction icons 6. a presentation window 8 with context-specific 
command icons 9. a notes window 1 1 . feedback icons 15, on-line status indicator 
1 9, and current time display 20. 

Each studenf s display also includes a number of commands, which the student may 
achate by using a Keyboard, mouse o, otoer input device to select a command from 
» the menu bar 1 or to point to the applicable icon. For example, these commands 
may include a signal to the instructor that the student wishes to ask a question or 
make a comment, that the student does not understand a particular aspect of the 
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presentation or that the student feels that the presentation is moving too slowly or 
too quickly. These commands may be initiated by selecting one of the feedback 

icons 15. 

An audiogenics conferencing capability allows full application sharing between the 
instructor and students. The instructor controls the content of the session, but may 
use the interaction icons 6 to permit any student to make comments on the 
presentation, which comments are transmitted to each of the other participants. 
Student comments may be made verbally, using the two-way audio facilities, or in 
writing, through typed or handwritten comments which appear in the presentation 
window 8 or the notes window 1 1 of each participant's screen. The instructor may 
also choose to communicate with each student individually, to provide additional 
information or guidance during on-line assignments. Interactions between the 
instructor and an individual student may be kept private from other students or may 
be shared with the rest of the class, at the option of the instructor or the student, 
through the use if the interaction icons 6. 

Figures 4, 5 and 6 show examples of the audio-visual and graphical information 
which may be selected from the course control window 3 and displayed in the 
presentation window 8. The instructor's window includes command icons 22 to 
controlthepresentationofvideoandaudiofiles. Graphical annotation 24. overlay 
20 33 and whiteboard 26 features permit the instructor or students to add more detailed 
information to a presentation. The presentation window 8 is scaleable to allow 
several features to be used simultaneously. When the whiteboard 26 function is 
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selected, the slide which was previously displayed is reduced in size and remains on 
the screen as a reference 28. Either the instructor or the student may control the 
size and positioning of the reference slide 28. 

Multiple levels of overlays may be used to annotate graphics or display context- 
sensitive labels 30, as shown in Figure 7, or to demonstrate a multi-step process, 
overlay or peel away segments to show different levels of an object or steps in a 
process 33. as shown in Figures 8, 12. 13 and 14. Overlays 33 may be added or 
removed using a context-sensitive control window 35. Overlays 33 may also be 
used to time the delivery of an audio file to provide additional information or add 
io emphasis. The whiteboard 26 feature may be used to highlight or explain 
information shown in the presentation window. Text may be displayed in the 
presentation window 8 and particular words or phrases may be emphasized using 
overlays of different colours and thickness 31 . The emphasis may be saved by the 
instructor and included in subsequent sessions, or by an individual student in a 
personal study file. 

The instructor may test student comprehension by asking periodic questions during 
the training session. Questions appear in the presentation window 8 and may be in 
the form of multiple choice, drag-and-drop matching, fill in the blanks, or true/false. 
Figure 9 shows an example of the use of labels 30 which are filled in by the student. 
20 Figure 10 shows the use of true or false questions, which the student answers by 
selecting the appropriate response icon 32 displayed in the presentation window 8. 
Similar icons may be used for multiple choice questions. Questions may be 
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displayed individually, in predetermined or random order, or may be displayed 
together as a test. During a test, the instructor may enable or disable specific 
elements of the database to provide either "open-book" testing, in which the student 
may search specified material for required information, or "closed-book" testing, in 
which the student must answer the questions from memory. 

The instructor may use the status window 13 to monitor the progress of an individual 
student or the class as a whole. In Figure 9 the status window 1 3 has been set to 
show the percentage of class members who have responded to each question. 
Student responses may be compiled and displayed on the instructor's screen 
immediately. They may also be saved for further analysis by the instructor. This 
feature provides immediate feedback to the instructor, who can adjust the 
presentation to provide more detailed information or repeat key points, as required. 
At the instructor's option, class and individual performance may be displayed to all 
students, or individual results may be shown to each student. 

The class status window 13 and feedback icons 15 allow the instructor to monitor 
the status of the class. Tabs 14 at the top of the status window 1 3 are used to 
select the information to be displayed. It is preferred that bar graph displays are 
used to visually convey class status information to the instructor. The "confusion" 
and "pace'' displays allow the instructor to monitor the effectiveness of the 
presentation. An audio or video alarm, with user-adjustable parameters, may be 
provided to alert the instructor when the class status measures reach a specified 
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threshold. For example, the alarm could be set to be triggered when more than 33 
percent of the class members indicate the pace is too slow or too fast. 
The instructor may obtain more detailed information about the feedback provided by 
individual students by selecting the student listing 38 from the drop down menu 4 of 
the course control window 3. The specific information displayed in the student listing 

38 may be varied by selecting one of the class status icons 39, as shown in Figures 

12, 13 and 14. 

The instructor may use the computer keyboard to make presentation notes, which 
are displayed in the notes window 1 1 on the instructor's screen. Each student may 
10 use the computer keyboard to make private notes and comments which are 

displayed only in the notes window 1 1 on the student's screen and which are saved 
for later reference. 

Annotations 24 may be made directly on the information in the presentation window 
8, using a touch-sensitive display screen or a graphical tablet and a pointing device 
adapted for that purpose. Alternatively, annotations 24 may be made using a 
pointing device such as a mouse. Annotations 24 may be made privately by either 
the instructor or the students or may be displayed to the entire class. 
All or part of a training session may be recorded for later review or distribution by 
either the instructor or the student. The session may be recorded by saving on a 
20 computer hwddrto or the on * 

line data and the instructions for combining that data with the previously distributed 
pre-recorded data. Using the command menu 1 , each student station can 
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automatically record the entire session, including audio components, presentation 
window commands and real-time annotations, class questions and instructor 
responses, and any other interactive elements of the session. The student can set 
his or her workstation in advance to record the session if the student is not present 
at the scheduled training time. The student can replay the recorded training session 
at any convenient time or times. 

Alternatively, the training session may be recorded at the instructor's location and 
the recorded session may be distributed to other members of the organization who 
may not have access to communication facilities or are otherwise unable to 
participate in the on-line sessions. These distributed training sessions may be used 
as stand-alone, self-paced training modules. The student may interact with the 
recorded session in the same manner as an on-line session. 
Students may also record specific parts of a training session. This feature may be 
used if the student does not fully understand a particular part of the presentation, but 
does not wish to stop the presentation to ask a question or request clarification. It 
may also be used if the student wishes to record a personal note or comment or to 
record a comment or annotation made by the instructor or another student. 

When recording all or part of a training session, the instructor or the student may 
assign one or more keywords to the training session or to specific portions of the 
20 session. This allows information associated with specific keywords to be saved and 
indexed in one or more databases, to be retrieved at a later time, regardless of 
where the material is stored. This feature allows specific information to be retrieved 

12 
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without the necessity of creating separate files to store and retrieve specific audio, 
video or text data. Students may "pause" the on-line presentation, while continuing 
to record the session, in order to attend to other related or unrelated tasks during the 
training session. The student may disconnect from the session at any time. On-line 
status icons 19 on the instructor's screen shows the number of students who have 
paused the presentation and the number of students who have disconnected from 
the session. 

One of the advantages of this invention is that it uses widely-available personal 
computers and computer programs. In its preferred embodiment, this method uses 
(i) an instructor station consisting of a 100mHz or faster Pentium computer, 
equipped with a CD-ROM drive, sound card, graphics tablet, audio headset and 28K 
modem; and (ii) student stations with a 66mHz or faster 486 class personal 
computer, equipped with a CD-ROM drive, sound card, graphics tablet, audio 
headset (or speakers and microphone) and 14K modem. In its preferred 
embodiment, each of the computers uses the Microsoft "Windows 95" operating 
system. The software used to implement the method uses the TCP/IP 
communications protocol. It will work over standard telephone lines; it will also work 
over local area networks (LANs), wide area networks (WANs), ISDN telephone lines 
and the Internet. 
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Claims 

I claim: 

1 A method of combining physically-delivered time-independent information and 
electronically-delivered time-sensitive information in which: 

a) the time independent information is delivered to geographically 
separated locations prior to the time-sensitive information; 

b) the time-sensitive information is simultaneously delivered from a single 
location to one or more individuals at the said geographically 
separated locations; and 

c) the said time-sensitive information is combined in an interactive 
manner with the said time-independent information at the said 
geographically separated locations. 

2. A method, as claimed in claim 1 , in which the combination of the said 
information is controlled by a person at the location from which the 
electronically-delivered information is sent 

3. A method, as claimed in claim 1 , in which the combination of the said 
information is controlled interactively by one or more persons at the 
geographically separated locations. 

4. A method, as claimed in claim 1, in which the information to be combined 
comprises one or more of the following types of electronic data: 
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a) live or pre-recorded audio; 

b) live or pre-recorded video; 

c) still photographs or drawings; 

d) animated graphics; 

e) alpha-numeric text; and 

f) hand-written annotations. 

5. A method, as claimed in claim 4, in which the data elements are 

simultaneously presented in one or more graphical "windows" which may be 
independently configured by each person receiving the information. 

,o 6. A method, as claimed in claim 2, in which the person controlling the 

combination of the information is able to temporarily transfer control to a 
person at one of the geographically remote locations. 

7. A method, as claimed in claim 2, in which the person controlling the 
combination of the information is able to alter the manner in which the 
information is combined in response to data inputs from the persons at the 
geographically remote locations. 

8. A method, as claimed in claim 7, in which the data inputs comprise one or 
more of the following: 

a) individual and collective comprehension levels; 
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b) individual and group feedback on the speed of delivery of the 
information; 

c) individual requests for further information; and 

d) individual requests for a transfer of control over the combination of the 
information. 

9. A method, as claimed in claim 1 , in which the combination of information may 
be recorded in whole or in part by the person controlling the combination or by 
any individual at one or more of the said geographically separated locations, 
by saving the data elements in the permanent memory of a personal 
computer, and the saved information may be retrieved, reviewed, altered and 
re-saved at a later time. 
10. A system for combining physically-delivered time-independent information 
and electronically-delivered time-sensitive information in which: 

a) the time independent information is delivered to the geographically 
separated locations prior to the time-sensitive information; 

b) the time-sensitive information is simultaneously delivered from a single 
location to one or more individuals at geographically separated 
locations; and 

c) the said time-sensitive information is combined in an interactive 
20 manner with the said time-independent information at the said 

geographically separated locations. 
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H A method of proving physically^ered time-independent information and 
electronically-delivered time-sensitive information, the time-independent 
information being adapted to combine with electronicalry-de.ivered time- 
sensitive information, comprising the steps of: 

a) delivering the time independent information to geographically 
separated locations prior to the time-sensitive information; 

b) simultaneously delivering the time sensitive information from a single 
location to one or more individuals at geographically separated 
locations; and 

c) combining the said time-sensitive information with the said time- 
independent information in an interactive manner at the said 
geographically separated locations. 

12. A method, as claimed in claim 11, in which the combination of the said 
information is controlled by a person at the location from which the 
electronically-delivered information is sent. 

13 A memod. as claimed in 

information is controlled interactively by one or more persons at the 

geographically separated locations. 
14. A method of providing interactive instruction relating to time-independent 

information on computers at geographically separated locations, comprising: 
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linking a computer at one location with computers at one or more 
geographically separated locations; 

providing time-sensitive information from the computer at one location 

to computers at geographically separated locations; 
combining the time-independent information with the time-sensitive 
information at the geographically separated locations by the use of 
computers at those locations; and 

receiving from the geographically separated locations data generated 
at those locations, analyzing that data at the single location and 
responding to it. 
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